Assessment Of Non-technical Skills Research Articles

A prospective randomized comparative study of effectiveness of simulation-based training in improving the performance of non-technical skill among postgraduate students during anaesthesia crisis resource management

Background Non-technical skills are pivotal in ensuring patient safety during anaesthesia crisis resource management. Simulation-based training has emerged as a promising educational approach for enhancing these skills. This study protocol outlines a prospective randomised comparative study aimed at assessing the impact of simulation-based training on the performance of anaesthesia residents during anaesthesia crisis resource management, with a focus on task management, teamwork, situational awareness, and decision-making skills, using the Assessment of Non-Technical Skills (ANTS) scoring system. Methods Anesthesia residents in postgraduate years 1 and 2 from the Department of Anesthesia at Acharya Vinoba Bhave Rural Hospital will be included as study participants. Informed consent will be obtained, and no exclusion criteria will be applied. Participants will undergo an orientation session covering essential crisis management and simulation knowledge. The study will employ advanced simulation equipment, including a Human Patient Simulator (HPS) mannequin, an anaesthesia machine, and a simulated operating room. Faculty members have selected six distinct perioperative emergency scenarios for simulation sessions. Participants will be grouped in pairs and exposed to three scenarios during each session. Debriefing and feedback will follow each scenario, reinforcing non-technical skills. Experienced staff anesthesiologists, trained in the Assessment of Non-Technical Skills (ANTS) scoring system, will serve as assessors to evaluate participant performance. Expected outcomes Data collected will include ANTS scores, debriefing feedback, and post-test results. Statistical analysis will be employed to assess the effectiveness of simulation-based training in enhancing non-technical skills among anaesthesia residents during anaesthesia crisis resource management.

Testing the validity of three acute care assessment tools for assessing residents' performance during in situ simulation: the ACAT-SimSit study.

The assessment of technical and nontechnical skills in emergency medicine requires reliable and usable tools. Three Acute Care Assessment Tools (ACATs) have been developed to assess medical learners in their management of cardiac arrest (ACAT-CA), coma (ACAT-coma) and acute respiratory failure (ACAT-ARF). This study aims to analyze the reliability and usability of the three ACATs when used for in situ (bedside) simulation. This prospective multicenter validation study tested ACATs using interprofessional in situ simulations in seven emergency departments and invited training residents to participate in them. Each session was rated by two independent raters using ACAT. Intraclass correlation coefficients (ICC) were used to assess interrater reliability, and Cronbach's alpha coefficient was used to assess internal consistency for each ACAT. The correlation between ACATs' scores and the learners' level of performance was also assessed. Finally, a questionnaire and two focus groups were used to assess the usability of the ACATs. A total of 104 in situ simulation sessions, including 85 residents, were evaluated by 37 raters. The ICC for ACAT-CA, ACAT-coma and ACAT-ARF were 0.95 [95% confidence interval (CI), 0.93-0.98], 0.89 (95% CI, 0.77-0.95) and 0.92 (95%CI 0.83-0.96), respectively. The Cronbach's alphas were 0.79, 0.80 and 0.73, respectively. The ACAT-CA and ARF showed good construct validity, as third-year residents obtained significantly higher scores than first-year residents (P < 0.001; P < 0.019). The raters supported the usability of the tools, even though they expressed concerns regarding the use of simulations in a summative way. This study reported that the three ACATs showed good external validity and usability.

Development and applications of the Anaesthetists’ Non-Technical Skills behavioural marker system: a systematic review

ObjectivesTo comprehensively synthesise evidence regarding the validity and reliability of the Anaesthetists’ Non-Technical Skills (ANTS) behavioural marker system and its application as a tool for the training and assessment of...

Teamwork matters: The association between nontechnical skills and cardiac arrest in trauma patients presenting with hypotension

BackgroundThe impact of trauma team dynamics on outcomes in injured patients is not completely understood. We sought to evaluate the association between trauma team function, as measured by a modified Trauma Non-Technical Skills assessment, and cardiac arrest in hypotensive trauma patients. We hypothesized that better team function is associated with a decreased probability of developing cardiac arrest. MethodsTrauma video review was used to collect data from resuscitations of adult hypotensive trauma patients at 19 centers. Hypotension at emergency department presentation was defined as an initial systolic blood pressure <90 mm Hg or an initial systolic blood pressure ≥90 mm Hg followed by a systolic blood pressure <90 mm Hg within the first 5 minutes. Team dynamics were scored using a modified Trauma Non-Technical Skills assessment composed of 5 domains with combined scores ranging from 5 (best) to 15 (worst). Scores were compared between cardiac arrest/noncardiac arrest cases in the trauma bay. Logistic regression was used to evaluate the independent association between the Trauma Non-Technical Skills assessment and cardiac arrest. ResultsA total of 430 patients were included (median age 43 years [interquartile range: 29–61]; 71.8% male; 36% penetrating mechanism; median Injury Severity Score 20 [10–33]; 11% experienced cardiac arrest in trauma bay). The median total Trauma Non-Technical Skills assessment score was 7 (6–9), higher in patients who experienced cardiac arrest in the trauma bay (9 [6–10] vs 7 [6–9]; P = .016). This association persisted after controlling for age, sex, mechanism, injury severity, initial systolic blood pressure, and initial Glasgow Coma Scale score (adjusted odds ratio: 1.28; 95% confidence interval:1.11–1.48; P < .001), indicating a ∼3% higher predicted probability of cardiac arrest per Trauma Non-Technical Skills point. ConclusionBetter team function is independently associated with a decreased probability of cardiac arrest in trauma patients presenting with hypotension. This suggests that trauma team training may improve outcomes in peri-arrest patients.

Surgical Sabermetrics: A Scoping Review of Technology-enhanced Assessment of Nontechnical Skills in the Operating Room.

To evaluate the current evidence for surgical sabermetrics: digital methods of assessing surgical nontechnical skills and investigate the implications for enhancing surgical performance. Surgeons need high-quality, objective, and timely feedback to optimize performance and patient safety. Digital tools to assess nontechnical skills have the potential to reduce human bias and aid scalability. However, we do not fully understand which of the myriad of digital metrics of performance assessment have efficacy for surgeons. A systematic review was conducted by searching PubMed, EMBASE, CINAHL, and PSYCINFO databases following PRISMA-ScR guidelines. MeSH terms and keywords included "Assessment," "Surgeons," and "Technology". Eligible studies included a digital assessment of nontechnical skills for surgeons, residents, and/or medical students within an operative context. From 19,229 articles screened, 81 articles met the inclusion criteria. The studies varied in surgical specialties, settings, and outcome measurements. A total of 122 distinct objective, digital metrics were utilized. Studies digitally measured at least 1 category of surgical nontechnical skill using a single (n=54) or multiple objective measures (n=27). The majority of studies utilized simulation (n=48) over live operative settings (n=32). Surgical Sabermetrics has been demonstrated to be beneficial in measuring cognitive load (n=57), situation awareness (n=24), communication (n=3), teamwork (n=13), and leadership (n=2). No studies measured intraoperative decision-making. The literature detailing the intersection between surgical data science and operative nontechnical skills is diverse and growing rapidly. Surgical Sabermetrics may provide a promising modifiable technique to achieve desirable outcomes for both the surgeon and the patient. This study identifies a diverse array of measurements possible with sensor devices and highlights research gaps, including the need for objective assessment of decision-making. Future studies may advance the integration of physiological sensors to provide a holistic assessment of surgical performance.

Evaluation of video review tools for assessing non-technical skills in emergency department resuscitation teams: a systematic review

Background and importanceUse of video review in medicine is established in contexts such as surgery. Although not widely used in the emergency department (ED), some centres use it to evaluate non-technical skills (NTS) to support teaching and quality improvement.ObjectiveThere is no consensus on assessment of NTS using video review in the ED and the purpose of this review was to identify tools used in this context.Design, setting and participantsStudies were identified using Embase, Medline, CINAHL and Google Scholar. Inclusion criterion for the review was NTS of resuscitation teams working within the ED were assessed using video review. A systematic search method was used, and results were synthesised after search criteria was checked by two independent reviewers. Authors settled on the same 9 studies eligible for inclusion.Outcome measures and analysisReliability and validity of tools identified for use in this context. Due to the heterogeneity of studies, no meta-analysis occurred.Main resultsThere are 9 studies included in the review. The review was registered with PROSPERO (Ref No: CRD42022306129). Four unique tools were identified – 6 studies used T-NOTECHS, 1 used TTCA-24, 1 used CALM and 1 used the Communication tool. T-NOTECHS is validated in the literature for use in this context.ConclusionT-NOTECHS is the tool of choice for assessing ED teams in this context.

Nontechnically speaking: A review of tools and methods in the teaching and assessment of nontechnical skills in emergency medicine training

Nontechnically speaking: A review of tools and methods in the teaching and assessment of nontechnical skills in emergency medicine training

The development of the helicopter non-technical skills (HeliNOTS) behavioural marker systems

Behavioural marker systems (observational frameworks geared towards the assessment of non-technical skills by way of behavioural markers) exist across a variety of high-risk occupations, however, no identifiable system currently exists developed from rotary operative data. In this study, discussion groups (n = 9) were undertaken with subject matter experts (n = 20)—including pilots and technical crew operating across search and rescue and offshore transport environments—with the objective of identifying role-specific behavioural markers. Systems were reviewed on an iterative basis by the academic team and received final reviews by additional subject matter experts (n = 6). Two behavioural marker systems were constructed: HeliNOTS (O) for offshore transport pilots and HeliNOTS (SAR) for search and rescue crews; each with domain-specific behavioural markers. Both represent a significant step towards a nuanced approach to training and assessment of helicopter flight crews’ non-technical skills and are the first publicly available systems tailored to these distinct mission types. Practitioner summary: There is no publicly available behavioural marker system based on data from rotary operatives. Across this study, two prototype systems were developed: HeliNOTS (SAR) for helicopter search and rescue, and HeliNOTS (O) for helicopter offshore transport. Both HeliNOTS systems represent a nuanced approach towards rotary CRM training and assessment.

A study of validity and usability evidence for non-technical skills assessment tools in simulated adult resuscitation scenarios

BackgroundNon-technical skills (NTS) assessment tools are widely used to provide formative and summative assessment for healthcare professionals and there are now many of them. This study has examined three different tools designed for similar settings and gathered evidence to test their validity and usability.MethodsThree NTS assessment tools designed for use in the UK were used by three experienced faculty to review standardized videos of simulated cardiac arrest scenarios: ANTS (Anesthetists’ Non-Technical Skills), Oxford NOTECHS (Oxford NOn-TECHnical Skills) and OSCAR (Observational Skill based Clinical Assessment tool for Resuscitation). Internal consistency, interrater reliability and quantitative and qualitative analysis of usability were analyzed for each tool.ResultsInternal consistency and interrater reliability (IRR) varied considerably for the three tools across NTS categories and elements. Intraclass correlation scores of three expert raters ranged from poor (task management in ANTS [0.26] and situation awareness (SA) in Oxford NOTECHS [0.34]) to very good (problem solving in Oxford NOTECHS [0.81] and cooperation [0.84] and SA [0.87] in OSCAR). Furthermore, different statistical tests of IRR produced different results for each tool. Quantitative and qualitative examination of usability also revealed challenges in using each tool.ConclusionsThe lack of standardization of NTS assessment tools and training in their use is unhelpful for healthcare educators and students. Educators require ongoing support in the use of NTS assessment tools for the evaluation of individual healthcare professionals or healthcare teams. Summative or high-stakes examinations using NTS assessment tools should be undertaken with at least two assessors to provide consensus scoring. In light of the renewed focus on simulation as an educational tool to support and enhance training recovery in the aftermath of COVID-19, it is even more important that assessment of these vital skills is standardized, simplified and supported with adequate training.

Analyzing interprofessional teamwork in the operating room: An exploratory observational study using conventional and alternative approaches

ABSTRACT Intraoperative teamwork is vital for patient safety. Conventional tools for studying intraoperative teamwork typically rely on behaviorally anchored rating scales applied at the individual or team level, while others capture narrative information across several units of analysis. This prospective observational study characterizes teamwork using two conventional tools (Operating Theatre Team Non-Technical Skills Assessment Tool [NOTECHS]; Team Emergency Assessment Measure [TEAM]), and one alternative approach (modified-Systems Engineering Initiative for Patient Safety [SEIPS] model). We aimed to explore the advantages and disadvantages of each for providing feedback to improve teamwork practice. Fifty consecutive surgical cases at a Canadian academic hospital were recorded with the OR Black Box®, analyzed by trained raters, and summarized descriptively. Teamwork performance was consistently high within and across cases rated with NOTECHS and TEAMS. For cases analyzed with the modified-SEIPS tool, both optimal and suboptimal teamwork behaviors were identified, and team resilience was frequently observed. NOTECHS and TEAM provided summative assessments and overall pattern descriptions, while SEIPS facilitated a deeper understanding of teamwork processes. As healthcare organizations continue to prioritize teamwork improvement, SEIPS may provide valuable insights regarding teamwork behavior and the broader context influencing performance. This may ultimately enhance the development and effectiveness of multi-level teamwork interventions.

The importance of considering social sciences in the assessment of non-technical skills in surgical simulation exercises

The importance of considering social sciences in the assessment of non-technical skills in surgical simulation exercises

Next in Surgical Data Science: Autonomous Non-Technical Skill Assessment in Minimally Invasive Surgery Training.

It is well understood that surgical skills largely define patient outcomes both in Minimally Invasive Surgery (MIS) and Robot-Assisted MIS (RAMIS). Non-technical surgical skills, including stress and distraction resilience, decision-making and situation awareness also contribute significantly. Autonomous, technologically supported objective skill assessment can be efficient tools to improve patient outcomes without the need to involve expert surgeon reviewers. However, autonomous non-technical skill assessments are unstandardized and open for more research. Recently, Surgical Data Science (SDS) has become able to improve the quality of interventional healthcare with big data and data processing techniques (capture, organization, analysis and modeling of data). SDS techniques can also help to achieve autonomous non-technical surgical skill assessments. An MIS training experiment is introduced to autonomously assess non-technical skills and to analyse the workload based on sensory data (video image and force) and a self-rating questionnaire (SURG-TLX). A sensorized surgical skill training phantom and adjacent training workflow were designed to simulate a complicated Laparoscopic Cholecystectomy task; the dissection of the cholecyst's peritonial layer and the safe clip application on the cystic artery in an uncomfortable environment. A total of 20 training sessions were recorded from 7 subjects (3 non-medicals, 2 residents, 1 expert surgeon and 1 expert MIS surgeon). Workload and learning curves were studied via SURG-TLX. For autonomous non-technical skill assessment, video image data with tracked instruments based on Channel and Spatial Reliability Tracker (CSRT) and force data were utilized. An autonomous time series classification was achieved by a Fully Convolutional Neural Network (FCN), where the class labels were provided by SURG-TLX. With unpaired t-tests, significant differences were found between the two groups (medical professionals and control) in certain workload components (mental demands, physical demands, and situational stress, p&lt;0.0001, 95% confidence interval, p&lt;0.05 for task complexity). With paired t-tests, the learning curves of the trials were also studied; the task complexity resulted in a significant difference between the first and the second trials. Autonomous non-technical skill classification was based on the FCN by applying the tool trajectories and force data as input. This resulted in a high accuracy (85%) on temporal demands classification based on the z component of the used forces and 75% accuracy for classifying mental demands/situational stress with the x component of the used forces validated with Leave One Out Cross-Validation. Non-technical skills and workload components can be classified autonomously based on measured training data. SDS can be effective via automated non-technical skill assessment.

Cross-cultural adaptation and validation of the Spanish version of the Anesthetists' Non-Technical Skills (ANTS) assessment tool

Study objectiveEstablish the transcultural validity of Anesthetists Non-Technical Skills (ANTS) in a Spanish-speaking country. DesignProspective cohort. SettingClinical simulation center. SubjectsForty-two Anesthesia PY2 and PY3 residents participated in the study. InterventionsFour clinical scenarios simulating anesthesia crises were assessed with a Spanish version of ANTS. Every simulated scenario was run twice with a time span of 3 to 4 months between them. MeasurementsTwo anesthesiologists independently assessed all simulated sessions using ANTS. The ANTS indicators of construct validity were obtained by confirmatory factor analysis. Various goodness-of-fit indices of the factorial model were calculated: Comparative Fit Index (CFI); Tucker-Lewis Adjustment Index (TLI) and Root Mean Square Error of Approximation (RMSEA). The standardized factor loadings and the determination coefficient (R2) was also estimated. Main resultsA total of 212 clinical scenarios were analyzed. The specified factorial model had the same grouping of elements in four domains as the original version of ANTS. The CFI index and the TLI were 0.99 and the RMSEA reached 0.07 (95% CI 0.06–0.08). All the standardized factor loadings were found to be >0.4. Also, the elements obtained an R2 value that fluctuated between 0.54 and 0.92. ConclusionsThe Spanish version of ANTS is a valid, reliable and a useful tool to assess non-technical skills in Spanish-speaking countries. The applicability of the instrument was comparable to the original setting. The high reliability of ANTS in our setting allows us to propose its use not just in an educational and research setting; it can be used as an assessment tool of non-technical skills.

The development of a tool to assess medical students’ non-technical skills – The Norwegian medical students’ non-technical skills (NorMS-NTS)

Purpose New physicians need to master non-technical skills (NTS), as high levels of NTS have been shown to increase patient safety. It has also been shown that NTS can be improved through training. This study aimed to establish the necessary NTS for Norwegian medical students to create a tool for formative and summative assessments. Methods Focus group interviews were conducted with colleagues and patients of newly graduated physicians. Interviews were then analyzed using card sort methods, and the identified NTS were used to establish a framework. Focus groups commented on a prototype of an NTS assessment tool. Finally, we conducted a search of existing tools and literature. The final tool was developed based on the combined inputs. Results We created Norwegian medical students’ non-technical skills (NorMS-NTS) assessment tool containing four main categories; together comprising 13 elements and a rating scale for the NTS of the person observed. Conclusions The NorMS-NTS represents a purpose-made tool for assessing newly graduated physicians’ NTS. It is similar to existing assessment tools but based on domain-specific user perspectives obtained through focus group interviews and feedback, integrated with results from a literature search, and with consideration of existing NTS tools.

Measuring the impact of simulation debriefing on the practices of interprofessional trauma teams using natural language processing

BackgroundNatural language processing (NLP) may be a tool for automating trauma teamwork assessment in simulated scenarios. MethodsUsing the Trauma Nontechnical Skills Assessment (T-NOTECHS), raters assessed video recordings of trauma teams in simulated pre-debrief (Sim1) and post-debrief (Sim2) trauma resuscitations. We developed codes through directed content analysis and created algorithms capturing teamwork-related discourse through NLP. Using a within subjects pre-post design (n = 150), we compared changes in teams' Sim1 versus Sim2 T-NOTECHS scores and automatically coded discourse to identify which NLP algorithms could identify skills assessed by the T-NOTECHS. ResultsAutomatically coded behaviors revealed significant post-debrief increases in teams' simulation discourse: Verbalizing Findings, Acknowledging Communication, Directed Communication, Directing Assessment and Role Assignment, and Leader as Hub for Information. ConclusionsOur results suggest NLP can capture changes in trauma team discourse. These findings have implications for the expedition of team assessment and innovations in real-time feedback when paired with speech-to-text technology.

Intraoperative Assessment of Non-Technical Skills for Surgeons (NOTSS) and Qualitative Description of their Effects on Intraoperative Performance

The aims of this study were (1) to evaluate the feasibility of using the Non-Technical Skills for Surgeons (NOTSS) rating tool in assessing surgeons' non-technical skills behaviors in live operations, and (2) to describe the effect of NOTSS on intraoperative performance. This study was conducted in an academic hospital in North America. Two observers independently conducted direct non-participant observations using the NOTSS rating tool to assess non-technical skills, and to document examples of effective or ineffective non-technical skills behaviors. Observers took field notes to document non-technical skill gaps that were not captured by the NOTSS rating tool, and situations or scenarios that presented challenges for accurate assessment. Interclass correlation estimates and 95% confidence intervals were calculated to assess the validity of the NOTSS rating tool. Deductive thematic qualitative data analysis was used for field notes and NOTSS behavior descriptions. Participants were general surgeons performing either minimally invasive (robotic assisted or laparoscopic surgery), or open procedures. We observed 18 surgeries, involving 6 surgeons, 11 residents and one fellow resulting in 37 hours of direct observations. The mean NOTSS score was 3.8 (SD 0.41) for situation awareness, 3.75 (SD 0.47) for decision-making, 3.71 (SD 0.39) for communication and teamwork, and 3.76 (SD 0.38) for leadership. The inter-rater reliability ranged between 0.65 and 0.80 for each NOTSS categories. The observers documented examples of effective non-technical skills behaviors and examples of behaviors that need improvement. Furthermore, we described the effect of each observed behavior on intraoperative performance. One challenge to NOTSS use in live surgery was that observers had to infer situation awareness, decision-making, and coping with pressure as these were not easily observed without attending surgeons articulating their underlying thought process. The use of the NOTSS tool in live surgery is a valid and practical tool to document observed behaviors and their effect on intraoperative performance in order to provide constructive feedback to surgeons. One notable limitation is that without specific articulation by the surgeon of their underlying thought process the observer must infer specific elements. By documenting specific real-world events with high inter-rater reliability and adequate surgeon score variation the process can be used to provide useful feedback for improvement.

Objective Nontechnical Skills Measurement Using Sensor-based Behavior Metrics in Surgical Teams.

The purpose of this study was to identify objective measures that predict surgeon nontechnical skills (NTS) during surgery. NTS are cognitive and social skills that impact operative performance and patient outcomes. Current methods for NTS assessment in surgery rely on observation-based tools to rate intraoperative behavior. These tools are resource intensive (e.g., time for observation or manual labeling) to perform; therefore, more efficient approaches are needed. Thirty-four robotic-assisted surgeries were observed. Proximity sensors were placed on the surgical team and voice recorders were placed on the surgeon. Surgeon NTS was assessed by trained observers using the NonTechnical Skills for Surgeons (NOTSS) tool. NTS behavior metrics from the sensors included communication, speech, and proximity features. The metrics were used to develop mixed effect models to predict NOTSS score and in machine learning classifiers to distinguish between exemplar NTS scores (highest NOTSS score) and non-exemplar scores. NTS metrics were collected from 16 nurses, 12 assistants, 11 anesthesiologists, and four surgeons. Nineteen behavior features and overall NOTSS score were significantly correlated (12 communication features, two speech features, five proximity features). The random forest classifier achieved the highest accuracy of 70% (80% F1 score) to predict exemplar NTS score. Sensor-based measures of communication, speech, and proximity can potentially predict NOTSS scores of surgeons during robotic-assisted surgery. These sensing-based approaches can be utilized for further reducing resource costs of NTS and team performance assessment in surgical environments. Sensor-based assessment of operative teams' behaviors can lead to objective, real-time NTS measurement.

Measurement of situation awareness in engine control room: approach for non-technical skill assessment in engine resource management

Measurement of situation awareness in engine control room: approach for non-technical skill assessment in engine resource management

Correlating Personal Resourcefulness and Psychomotor Skills: An Analysis of Stress, Visual Attention and Technical Metrics.

Modern surgical education is focused on making use of the available technologies in order to train and assess surgical skill acquisition. Innovative technologies for the automatic, objective assessment of nontechnical skills are currently under research. The main aim of this study is to determine whether personal resourcefulness can be assessed by monitoring parameters that are related to stress and visual attention and whether there is a relation between these and psychomotor skills in surgical education. For this purpose, we implemented an application in order to monitor the electrocardiogram (ECG), galvanic skin response (GSR), gaze and performance of surgeons-in-training while performing a laparoscopic box-trainer task so as to obtain technical and personal resourcefulness’ metrics. Eight surgeons (6 nonexperts and 2 experts) completed the experiment. A total of 22 metrics were calculated (7 technical and 15 related to personal resourcefulness) per subject. The average values of these metrics in the presence of stressors were compared with those in their absence and depending on the participants’ expertise. The results show that both the mean normalized GSR signal and average surgical instrument’s acceleration change significantly when stressors are present. Additionally, the GSR and acceleration were found to be correlated, which indicates that there is a relation between psychomotor skills and personal resourcefulness.

A scoping review of nontechnical skill assessment tools to evaluate trauma team performance.

The objective of this scoping review was to identify assessment tools of trauma team performance (outside of technical skills) and assess the validity and reliability of each tool in assessing trauma team performance. We searched Embase, Cochrane Library, Web of Science, Ovid Medline, and Cumulative Index to Nursing and Allied Health Literature from inception to June 1, 2021. English studies that evaluated trauma team performance using nontechnical skill assessment tools in a simulation or real-world setting were included. Studies were assessed by two independent reviewers for meeting inclusion/exclusion criteria. Data regarding team assessment tools were extracted and synthesized into behavior domains. Each tool was then assessed for validity and reliability. The literature search returned 4,215 articles with 29 meeting inclusion criteria. Our search identified 12 trauma team performance assessment tools. Most studies were conducted in the United States (n = 20 [69%]). Twenty studies (69%) assessed trauma team performance in a simulation setting; Team Emergency Assessment Measure (TEAM) and Trauma Nontechnical Skills Scale (T-NOTECHS) were the only tools to be applied in a simulation and real-world setting. Most studies assessed trauma team performance using video review technology (n = 17 [59%]). Five overarching themes were designed to encompass behavioral domains captured across the 12 tools: (1) Leadership, (2) Communication, (3) Teamwork, (4) Assessment, and (5) Situation Awareness. The reliability and validity of T-NOTECHS were investigated by the greatest number of studies (n = 13); however, TEAM had the most robust evidence of reliability and validity. We identified 12 trauma team performance tools that assessed nontechnical skills to varying degrees. Trauma Nontechnical Skills Scale and TEAM tools had the most evidence to support their reliability and validity. Considering the limited research in the impact of trauma team performance on patient outcomes, future studies could use video review technology in authentic trauma cases to further study this important relationship. Systematic reviews and meta-analyses, level IV.